DOCUMENT RESUME 



ED 402 819 



HE 029 736 



AUTHOR 

TITLE 



INSTITUTION 

PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Whi tmire , Ethel ene 

Undergraduate Students’ Development of Critical 
Thinking Skills: An Institutional and Disciplinary 
Analysis and Comparison with Academic Library Use and 
Other Measures, ASHE Annual Meeting Paper. 

Michigan Univ. , Ann Arbor. Center for the Study of 
Higher and Pos ts econdary Education. 

Nov 96 

29p. ; Paper presented at the Annual Meeting of the 
Association for the Study of Higher Education (21st, 
Memphis, TN, October 31 - November 3, 1996). 

Reports - Research/Technical (143) — 
Speeches/Conference Papers (150) 

MF01/PC02 Plus Postage. 

^Academic Libraries; *College Environment; College 
Libraries; ’‘Critical Thinking; Educational 
Environment; Higher Education; *Int el 1 ec tual 
Development; Intellectual Disciplines; Self 
Evaluation (individuals) ; *Student Characteristics; 
Student Experience; Student School Relationship; 
Thinking Skills; ’‘Undergraduate Students 
’‘ASHE Annual Meeting 



ABSTRACT 
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environment on the estimated gains of critical thinking skills in 
undergraduate students (N=9,361). The study used data from a 
national, cross-sect ional survey completed by undergraduate students 
during the academic year. Results of multiple regression analyses 
indicated that a student’s perception of the college environment was 
the best predictor of a student’s estimated gains in critical 
thinking skills. Students who perceived their college environment to 
be scholarly were more inclined tc report greater gains in critical 
thinking skills. Student use of the academic library and background 
characteristics of students were not predictors of estimated gains in 
critical thinking skills. Students attending associate of arts 
institutions reported higher perceptions of increased critical 
thinking skills than students in research, comprehensive, and liberal 
arts schools. Additionally, students in the humanities reported lower 
estimated gains in critical thinking skills when compared with 
students majoring in the physical sciences, social sciences, 
business, and engineering. The findings suggest that students’ 
background characteristics and the academic library do not have a 
great impact on developing the critical thinking skills of 
undergraduate students. (Contains 21 references.) (Author/PRW) . 
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Undergraduate Students’ Development of Critical Thinking Skills: An Institutional 
and Disciplinary Analysis and Comparison with Academic Library Use and Other 

Measures 



Abstract 

The primary purpose of this study is to examine the influence of background 
characteristics, disciplinary differences, institutional context, academic library experiences, 
and the perceptions of the college environment on the estimated gains of critical thinking 
skills in undergraduate students. The study examines data from a national, cross-sectional 
survey completed by undergraduate students during the academic year. Results of 
multiple regression analyses indicate that students’ perception of the college environment 
is the best predictor of students’ estimated gains in critical thinking skills. Use of the 
academic library and student background characteristics were not as crucial in predicting 
estimated gains io critical thinking skills. Further, students attending associate of arts 
institutions reported higher perceptions of increased critical thinking skills. Additionally, 
students in the humanities reported lower estimated gains in critical thinking skills when 
compared with students majoring in the physical sciences, social sciences, business, and 
engineering. Implications of the findings suggest that students’ background 
characteristics and the academic library is not having a great impact on developing the 
critical thinking skills of undergraduate students. 
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Introduction 

The development of critical thinking skills is a significant component of 
undergraduate education. Academic libraries have also began trying to infuse the 
development of critical thinking into library services and programs. In fact, academic 
librarians and faculty have collaborated on incorporating academic library use into the 
curriculum and fostering critical thinking among undergraduate students (Gowler, 1995; 
MacAdam & Kemp; 1989; Mech, 1990). Consequently, “critical thinking in higher 
education has been the focus of considerable discussion and program development within 
academic libraries in recent years” (MacAdam, 1995). Examining the disciplinary context 
of almost all academic endeavors is important for those who work in higher education 
(Hativa & Marincovich, 1996). Investigating the academic library experiences of 
undergraduates within the disciplinary context is no exception. Plum (1984) examined the 
development of critical thinking skills in library instruction using the academic discipline as 
the framework. 

The purpose of this study is to examine the influence of background 
characteristics, disciplinary differences, institutional context, academic library experiences, 
and the perceptions of college environment on the development of critical thinking skills in 
undergraduate students. My specific research question is: (1) What is the influence of 
background characteristics including disciplinary and institutional differences, academic 
library experiences, and perceptions of the college environment on the development of 
students’ critical thinking skills? 
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Conceptual Framework 

The literature from several areas frames my inquiry: higher education literature on 
college environments (including literature on disciplinary differences), empirical academic 
library use studies, and theoretical papers on critical thinking. Studies about disciplinary 
differences have found that academic departments are subenvironments of the college 
environment. 

Differences in academic disciplines are evident in class size, course content, and 
instructional methods (Astin, 1993). Further, Weaver (1981) found that “the character of 
academic disciplines profoundly influences the curricular organization and pedagogical 
practices of undergraduate education” (p. 151). Becher (1987) asserts that “commonly, 
the characteristics of a given discipline begin to come quite sharply into focus at the 
undergraduate stage” (p. 281). Finally, Becher (1987) found that “it is the parent 
discipline that most strongly influences the characteristic features of its intellectual 
offspring” (p. 278). Indeed, Wells (1995) found that the most significant factor associated 
with academic library use was the discipline the student was studying. Plum (1984) found 
that the most useful framework to examine library use and the development of critical 
thinking was within the context of the discipline. Each discipline has a “distinctive process 
of original research, literature structures, and library systems that organize and identify 
that literature” (p. 32). 

In addition to examining disciplinary differences, I also examined distinctions 
between disciplines within distinctive institutional contexts. Institutions have particular 
climates defined as “persistent patterns or norms, values, practices, beliefs, and 
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assumptions that shape the behavior of individuals and groups in a college or university” 
(Kuh and Whitt, 1988). However, other authors suggest that disciplinary cultures 
transcend institutional and national boundaries (Becher, 1994, p. 153). Weaver (1981) 
declares that “by the late 1940s and early 1950s, the department had become the point of 
intersection between disciplines and institutions” (p. 154). 

The third set of studies that frame my research is academic library use literature. 

Older students were found to borrow the most items from the academic library (Mays, 

1986). Gender has not been a consistent predictor of library use. In schools that had a 

more even distribution of male and female students, females outborrowed the males 
M ¥ 

(Mays, 1986). Lane (1966) found that the majority of men borrowed no books. Females 
did not use the library bibliographical tools more than the male students according to 
Hiscock (1982). Additionally, of the students who remained in school, men borrowed 
more than women (Kramer & Kramer, 1968). Kramer & Kramer (1968) found the 
majority of freshmen (65%) borrowed no books. Seniors used the library the most, next 
came sophomores, and then freshmen. In terms of borrowing, the number of books 
borrowed increased from freshmen to sophomore to junior year with a slight decrease in 
senior year (Lane, 1966). Reluctance to ask librarians questions decreased with each 
class year, for example, juniors were less afraid to approach librarians than were freshmen 
(Kosa, 1982). Generally, the higher the grade point average (GPA) the more books 
borrowed (Mays, 1986). There was a positive correlation between (1) grade achieved and 
the total time spent in the library during the semester, and (2) frequency of library visits 
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and grade achieved, and (3) average amount of time spent in the library and grade 
achieved, but they were not statistically significant (Wells, 1995). 

A positive correlational relationship between GPA and the number of books 
withdrawn failed to reach statistical significance (Lane, 1966). The students with the 
highest GPAs did the most borrowing (Kramer & Kramer, 1968). Students with low 
GPAs who continued or persisted made significantly greater use of the facilities, including 
the library, than students with low GPAs who dropped out of college (Churchill & Iwai, 
1981). 

The most significant factor associated with academic library usage was the 
discipline the student was studying (Mays, 1986). According to Wells (1995) “liberal arts 
subject areas were associated with more library use and it was conjectured that students in 
vocational courses such as business have more clearly defined academic goals which 
preclude the search for ideas, knowledge and prescribed information. Another tentative 
conclusion was that many of the disciplines associated with reduced measured library use 
are journal-dependent, and in-library use was not calculated." In general, students 
majoring in the fields of education, English, history, and political science, and possibly 
biology and nursing, consistently withdrew more books than students in other major fields 
(Lane, 1966). Previous studies have been conducted evaluating the influence of 
institutional type on academic library use (Ettelt, 1978; Ettelt, 1981). Although previous 
studies have not examined race or ethnicity I have included this variable in this study. 
METHODOLOGY 
Data Source 
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This study utilized data obtained from the 1992 - 1993 College Student 
Experiences Questionnaire (CSEQ) developed by C. Robert Pace in 1979. 1 The CSEQ 
was designed to determine the quality of effort that students put into using the campus 
facilities among other items (Pace, 1984). I examined data from four sections of the 
CSEQ: (1) background information, (2) library experiences, (3) perceptions of the college 
environment, and (4) estimate of gains. Missing data was coded. 

Measures 

I included a total of seven independent variables related to background information 

in the study based upon previous academic library use literature: age, sex, classification in 

/ •». * 

college, grades, major field of study, racial or ethnic identification, and institutional type. 

I selected nine variables measuring academic library use from the library 
experiences scale that contains 10 items measuring frequency of experiences. 

Additionally, I selected three variables identified as measuring perceptions of the college 
environment as a scholarly environment from the college environment scale. Finally, I 
selected variables that measured critical thinking skills from the estimate of gains scales. 

All measures used in the study and codings are located in Table A-l . 

Subjects 

I limited the analyses to undergraduate students at all class level (freshmen, 
sophomores, juniors, and seniors) and at all institutional types (Research Universities 
(RU), Doctoral Universities (DU), Comprehensive Colleges & Universities (CCU), 
General Liberal Arts Colleges (GLA), Selective Liberal Arts Colleges (SLA) and 



1 Data was provided by the Center for Postsecondary Research and Planning at Indiana University and 
was used with permission. 
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Associate of Art Institutions (AAI). I combined SLAs and GLAs to create a new 
category named Liberal Arts. I selected disciplines from humanities, physical sciences, 
social sciences as well as engineering and business so as to achieve a cross-section of 
scholarly areas. The CSEQ defined the fields as follows: humanities (literature, history, 
philosophy, religion, etc ); sciences (biological sciences = biology, biochemistry, botany, 
zoology, etc.; physical sciences = physics, chemistry, mathematics, astronomy, earth 
science, etc ); social sciences (economics, political science, psychology, sociology, etc ), 
engineering; and business. (Tables 1 - 5 provides descriptive information of my sample, 
based on means and standard deviations for all variables in the study). 

I eliminated students who selected “other” as their racial or ethnic identification 
and graduate students from the sample. Additionally, I eliminated institutions that were 
not immediately identifiable as one of the types identified above. 

The total sample was 9,361 students distributed across the disciplines as follows: 
humanities (1,014), physical sciences (1,988), social sciences (2,335), engineering (1,134), 
and business (2,890). 

Analyses 

I conducted exploratory factor analyses, utilizing orthogonal, principal axis factor 
rotation methods, to reduce the number of measured variables for analyses and to 
eliminate highly correlated variables. I used oblique factor analysis in this study because I 
assumed that these factors are correlated. I retained items that had a factor score of at 
least a .35 or over in the development of subsequent scales. These results are in Table 6, 
along with alpha reliabilities. I dropped the variable “Used the library as a quiet place to 
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read or study materials you brought with you” from the library experiences scales because 
of its low factor score (below .35). Additionally, I also dropped two variables, “emphasis 
on the development of vocational and occupational competence” and “emphasis on the 
personal relevance and practical values of your courses” from the perceptions of the 
college environment. These two variables had lower factor scores than the three 
remaining variables and the content of the statement did not meet my definition of 
perceptions of a scholarly college environment. (Tables 6 and A-2 report the results of the 
factor analyses). 

I substituted missing data with the means for each variable. I created dummy 
variables for both the institutional type and major field of study variables. I used the 
Associate of Arts Institutions and the majors in the Sciences comparison groups. I 
conducted a multiple regression analysis to identify the significant determinants of the 
development of critical thinking skills. First, I entered independent variables that reflected 
student background characteristics. Secondly, I entered the library experiences factors, 
and finally I entered the perceptions of the college environment factors. The order in 
which the sets of variables were entered was based on the work of Blackburn and 
Lawrence (1995) and Fishbein and Ajzen (1975). (See Table A-l for a listing of scales 
and measures used in the regression model). 

Results 

In order to examine the degree to which students from different institutional types 
with different majors differed by the student background characteristics, perceptions of the 
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college environment, and estimate of gains, I calculated mean levels and standard 
deviations. (The results of all means and standard deviations are reported in Tables 1 - 5). 

Block hierarchical regression analyses revealed that, in terms of estimated gains in 
critical thinking skills, perceptions of the college environment accounted for the largest 
share of the explained variance (10%) when compared to student background 
characteristics (5%), and library searching (2%) and library reference activities (2%) for a 
total of 19%. 

Table 7 shows the beta coefficients from regressing estimated gains of critical 
thinking skills on each of the independent measures. Based upon the students’ 
background characteristics, the results of the multiple regression analyses indicate older 
students are less likely to report gains in critical thinking skills. Interestingly, juniors and 
seniors are more likely to report gains in critical thinking skills. Students with higher 
grade point averages also reported greater gains in critical thinking skills. Gains in critical 
thinking skills were less likely to be reported by students in the humanities when compared 
to students in other fields. Engineering students reported more significant gains in critical 
thinking skills than students in business. Students in research, comprehensive, and liberal 
arts schools reported lower gains in critical thinking skills when compared to students in 
associate of arts institutions. 

Students’ perceptions of the college environment had a high beta (.30). If 
students’ perceived their college environment to be scholarly they were more inclined to 
report greater gains in critical thinking skills. Finally, the greater the frequency of library 
activities the more likely that students were reporting gains in their critical thinking skills. 
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Discussion 

This study provides insights into determining what factors influence estimated 
gains of critical thinking skills in undergraduates majoring in different disciplines and 
attending different institutional types. I assessed background characteristics, the 
perception of the institutional climate, and academic library experiences in order to 
understand their influence on the development of critical thinking skills. 

Implications 

The results of the analyses indicate that undergraduate students’ perceptions of 

their college environment has the most influence on students reporting gains in their 

" “ * 

development of critical thinking skills. This study does not address what college 
experiences determine students’ perceptions of their college environment. Future studies 
might analyze types of college experiences that influences students’ perceptions of their 
college environment. An analysis of course content, instructional and evaluation methods 
(i.e. types of assignments, lectures, examinations, research papers) in each discipline might 
be helpful to address why there are disciplinary differences in reporting gains in critical 
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Table 1 

Means and Standard Deviations of Background Information,' Library Experiences, Perceptions of the College Environment, and Estimate of Gains by 
Discipline by Institutional Type Humanities (N=1014) 

Research Doctoral Comprehensive Liberal Arts Associate 

Mean SD N Mean SD N Mean SD N Mean SD N Mean SD 
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Table 4 

Means and Standard Deviations of Background Information, Library Experiences, Perceptions of the College Environment, and Estimate of Gains by 
Discipline by Institutional Type Engineering (N=1134) 
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Note: Variable scales are reported in table A-l. 



Table 5 

Means and Standard Deviations of Background Information, Library Experiences, Perceptions of the College Environment, and Estimate of Gains by 
Discipline bv Institutional Type Business (N=2890) 

Research Doctoral Comprehensive Liberal Arts Associate 
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Note: Variable scales are reported in table A-l. 
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Table 6 



Factor Loadings and Internal Consistencies for Exploratory Factor Model of Library Experiences, 
Perceptions of the College Environment, and Estimate of Gains Variables 



Factors and Survey Items Factor Loading Internal Consistency 

(Alpha) 



Library Reference Activities 




.77 


Used indexes to journal articles 


.68 




Developed bibliography 


.66 




Used card catalogue or computer 


.65 




Asked librarian for help 


.49 




Read in reserve or reference section 


.44 




Library Probing Activities 




.76 


Checked citations in things read 


.66 




Read basic references or documents 


.66 




Found material by browning in stacks 


.64 




Checked out books * * 


.52 




Perceptions of the College Environment 




.77 


Emphasis on being critical, evaluative 


.70 




Academic, scholarly qualities 


.69 




Esthetic, expressive, creative qualities 


.65 




Estimate of Gains 




.82 


Gain in ability to put ideas together 


.68 




Gain in ability to think analytically 


.61 




Gain in ability to learn on own 


.53 




Gain in quantitative thinking 


.51 
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Table 7 

Summary of Hierarchical Regression Analysis for Variables Predicting Estimated Gains of Critical 
Thinking Skills 



Variable 


Beta 


Significance 


Step 1 


Age of student 


-.050 


*** 




Classification in college 


.192 


*** 




Most college grades 


.081 * 


*** 




Race/Ethnicity 


-.013 






Gender of student 


-.014 






Humanities 


-.030 


*** 




Social Science 


-.005 






Engineer 


.097 


*** 




Business 


.014 


* 




Research 


-.042 


* 




Doctoral 


-.021 






Comprehensive, 


-.058 


* 




Liberal Arts <* 


-.050 


** 




R 2 for Block One = .05 






Step 2 


Perceptions of the College Environment 


.302 


*** 




R 2 for Block Two = .15 






Step 3 


Library Reference Activities 


.088 


*** 




R 2 for Block Three =17 






Step 4 


Library Search^ n g ArtivitiM 


.126 


*** 




R 2 for Final Block =19 







Variable scales are reported in Table A-l. (*p= < 05. **p =< 01, ***p=< 001) 
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Appendix 

Table A-l 

Measures and Scales for the Regression Model 

Background Information 

Age 

Class 

Grades 

Race 

Gender 

Humanities 

Sciences 

Social Science 

Engineering 

Business 

Research Universities 
Doctoral Universities 
Comprehensive Colleges and Universities 
Selective and General Literal Arts Colleges 
Associate of Arts Institutions 

Library Experiences 

Used card catalogue or computer 

Asked librarian for help 

Read in reserve or reference section 

Used indexes to journal articles 

Developed bibliography 

Found material by browsing in stacks 

Checked citations in things read 

Read basic references or documents 

Checked out books 

Perceptions of the College Environment 
Academic, scholarly qualities 
Esthetic, expressive, creative qualities 
Emphasis on being critical, evaluative 

Estimate of Gains 
Gain in ability to think analytically 
Gain in quantitative thinking 
Gain in ability to put ideas together 
Gain in ability to learn on own 



1 = 22 or younger to 3 = 28 or older 
1 = freshman to 4 = senior 
1 = C, C, or lower to 5 = A 
1 = minority; 0 = white 
1 = female; 0 = male 
1 = humanities; 0 = else 
(excluded category) 

1 = social science; 0 = else 
1 = engineering; 0 = else 
1 = business; 0 = else 
1 = research; 0 = else 
1 = doctoral; 0 = else 
1 = comprehensive; 0 = else 
1 = liberal arts; 0 = else 
(excluded category) 



1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 
1 = never to 4 = very often 

1 = weak emphasis to 7 = strong emphasis 
1 = weak emphasis to 7 = strong emphasis 
1 = weak emphasis to 7 = strong emphasis 

1 = very little to 4 = very much 
1 = very little to 4 = very much 
1 = very little to 4 = very much 
1 = very little to 4 = very much 
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Table A-2 

Factor Scale: Estimates of Internal Consistencies (Alpha) by Student Sample 



Factor Scale 



Number 
of items 



Library Reference Activities 5 

Library Probing Activities 4 

Perceptions of the College Environment 3 

Estimate of Gains 4 



.77 

.76 

.77 

.82 



Note: Items constituting each scale are reported in Table 6. 

Exploratory procedures used to develop scales are reported in the methodology section. 
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